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This report on trends in school improvement test 
results presents an analysis and synthesis of 1978-1984 student 
performance data from four state-mandated testing programs: (1) the 
Educational Quality Assessment Program in Pennsylvania; (2) the 
Minimum Basic Skills Program in New Jersey; (3) the Delaware 
Educational Assessment Program in Delaware; and (4) the California 
Achievement Tests in Maryland. Although the overall goal of each 
state program is assessing performance related to designated learning 
objectives, the programs vary widely in basic content and analytic 
approach. The assessment analyzed performance data at the elementary, 
intermediate, and secondary levels of schooling, focusing on 
year-to-year trends. The analysis had two major components: (1) 
assessment of the common performance areas of reading and 
mathematics; and (2) the assessment of unique performance areas which 
addressed content skills only with a particular state (self-esteem, 
understanding others, writing, interest in school, social 
responsibility, knowledge of law and government, health, creativity, 
career awareness, appreciating human accomplishments, and knowledge 
of human accomplishments, in Pennsylvania; spelling and language, in 
Delaware; and language, in Maryland). The findings suggest that 
student achievement performance trends in the four state regions are 
generally positive and consistent with results of the National 
Assessment of Educational Progress. Long term trends tend to be most 
positive at the elementary level and decrease at the intermediate and 
secondary levels, suggesting that more attention be given to school 
improvement programs aimed at secondary education. (BS) 
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INTRODUCTION 



This document represents part of an overall regional needs assessment 
effort undertaken by Research by Better Schools (RBS) . The needs 
assessment function at RBS is an integral part of the laboratory's overall 
planning and development process. Needs assessment activities are intended 
to facilitate review of the regional responsiveness of current laboratory 
programs, possible redirection of programs or establishment of new 
programs, and feedback to the National Institute of Education, as well as 
state departments of education, regarding empirically derived needs. One 
of the major needs assessment activities is the examination of student 
performance data related to designated learning goals for each of the 
states in the region surrounding RBS (PA, NJ, DE, MD) . 

Each state education agency (SEA) in this region has a mandated 
testing program to assess student performance, particularly in the basic 
skills areas. Pennsylvania has the Educational Quality Assessment (EQA) 
Program; New Jersey has the Miv^imum Basic Skills (MBS) Program; Delaware 
has the Delaware Educational Assessment Program (DEAP) ; and Maryland uses 
the California Achievement Tests (CAT) for norm-referenced testing. Table 
1 presents an overview of the four testing programs discussed in this 



, 1 
reoort. 



As can be seen in Table 1, although the overall goal of each state 
program aims at the assessment of performance related to designated 
learning objectives, the programs vary widely with regard to basic content 
and analytic approach. The respective programs compare student performance 



^Other assessment programs or procedures are also used: e g 
Pennsylvania has a criterion-referenced testing program; New'jersey has 
recently begun administering a high school proficiency test; and 
Maryland s Project Basic program includes criterion-referenced testing 
ror high school graduation. 
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Table 1 

Overvlev of State Testing Prograas 



State 



KJ 



DE 



MD 



Testing 
Progran 



Educational 
Quality 
Assessaent 
(EQA) 



HlQiauD Baalc 
Skills (KBS) 



Delaware Educa- 
tional Aaiess- 
ont Prograo 
(DEAP) 



Aaaesaiaeac 
PrograiD 



General Context 



State-developed test vlch 
U Subtests: readings 
aath, aclf-esteea, under' 
standing others, writing, 
interest in school, 
societal respoDsibllity, 
knowledge of law/govt., 
health, creativity, career 
awareness, appreciating 
huoan acconplishtents, 
knowledge of huua #ccoti- 
pllshoents, infoniatlon 
usage 



State-developed test with 
reading and oath subtests 



California Achieveaent 
Test iCKt) in 4 lajor 
areas; readlog, uth- 
ematlcs, spelling, 
language (1978-1983) 
Coaprehenslve Teat of 
Basic Skills (CTBS) In 
four Mjor areas; reading, 
natheMtlCBp spelling, 
language (1984) 



California Achieveoent 
Teat (aT) in 3 r^Jor 
areas: reading conpre- 
henslon, Datheoatlcs, and 
language 



Grades 
Tested 



5. fi, II 



Statewide Nonalng 
Score Types 



raw scores 



Testing Saiple 



9, 10* 
(/a 1983) 
(Id J984) 



1-8. il 



3, S. 8 



KBS scores (equated 
to 1976 test saaplej 



voluntary, required 
every 5 years (dif- 
ferent sample each 
year) 



Primary Unit of 
Analysis/Reporting 



school level 



nomal curve equl- 
valenta (KCE), 
referenced to 
national nons 



ull districts 
each y^ar 



scale scores 



all districts, 
each year 



district level 



all districts, 
each year 



state, district, 
and school levels 



state, district, 
and school levels 



ProD 1978 to 1982, the HBS test was administered to students In urades 3 6 9 .r,? tl u mi 

grade students, and in 1984 only to 9th grade studen " e Ne^^^^^^ ^" ^ «ialnlstered only to 9th and lOth 

school proficiency exaainatlon/ ^ * ^°^^fency test to a wider ranging high 
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with either statewide norms (Pennsylvania) , national norms (Delaware and 
Maryland), or state-established success criteria (New Jersey). In Delaware 
and Maryland commercial standardized test series (the California 
Achievement Test and the Comprehensive Test of Basic Skills) are used, 
while the other two states use locally developed instrument packages. The 
Pennsylvania EQA includes 14 subtests addressing several different types of 
outcomes, whereas the New Jersey MBS focuses primarily on two areas of 
basic skills learning (although a writing assessment will be added). 
Maryland's testing includes reading comprehension, mathematics, and 
language. Delaware, in addition to reading, mathematics, and language, 
assesses students' skills in spelling. Each state administers these tests 
to different grades. 

Delaware, New Jersey, and Maryland samples are relatively consistent 
from year to year, while Pennsylvania samples differ since participation in 
the test is voluntary to some extent. Each state reports norms in terms of 
different scoring procedures. In addition, the primary unit for reporting 
test results differs between states. For Pennsylvania, individual schools 
are intended as the primary units of analysis, whereas districts are 
intended as the primary units for New Jersey's MBS test. In Delaware and 
Maryland results are analyzed and reported at multiple levels. 

This report on trends in school improvement test results presents an 
analysis and synthesis of student performance data collected through 
state-mandated testing programs from 1978 to 1984. Subsequent sections of 
the report describe the analysis approach, discuss performance results, and 
summarize conclusions based on the analysis. 

2 

This report is the third in a series of reports examining trends in 
state-wide test results: Blester, T. and Dusewicz R. Trends in School 
Improveme nt State-Wide Test Results . Philadelphia : Research for 
Better Schools, 1982; Blester T. and Dusewicz, R. Trends in School 
Improvemen t State-Wide Test Results, 1978-1983 . Philadelphia: 
Research for Better Schools, 1983. 
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ANALYSIS APPROACH 



The RBS assessment of student performance in the four states 
consisted of a secondary analysis of existing data available from the 
statewide testing programs. The analysis had two major components: 

• assessment of common performance areas 

• assessment of unique performance areas. 

The analysis of common performance areas focused on assessment of student 
basic skills achievement (i.e., reading and math). The analysis of unique 
performance areas addressed content skills assessed only within a 
particular state (e.g., self-esteem in Pennsylvania). 

Performance data were analyzed at three levels of schooling: 

• elementary 

• intermediate 

• secondary 

The grades tested were somewhat different across states. Results from 
:^rades 5, 8, and 11 were available to assess the three respective levels 
for Pennsylvania and Delaware. Results from grades 6, 9, and 11 were 
available for New Jersey for 1978 through 1982, but only grade 9 in 1983 
and 1984. For Maryland, grades 5 and 8 were used for the elementary and 
intermediate levels. No data were available at the secondary level since 
the CAT is not used beyond grade 8. 

A major focus of the analysis was upon year-to-year trends in student 
performance. This year's (1984) test results were examined in light of 
results of prior years to determine if performance was stable, improving, 
or declining. Baseline data from the 1977-1978 school year, as well as 
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from several subsequent years, were available from three states. Maryland 
began using the CAT in 1980-1981, so the test results from 1977 to 1980 had 
be estimated using the method of least squares. 

Although the analysis of trends within a state is relatively 
straight-forward, the synthesis of results across states was difficult due 
to the major differences between test content, norms, and types of scores. 
The analysis of trends across states required the conversion of existing 
test scores to a common testing metric. For this purpose, baseline scores 
(i.e., 1978 mean scores) were arbitrarily set as standard scores of 50, and 
converted standard score means for subsequent years were compared to the 
baseline distributions. All scores were converted to standard scores based 
on a mean of 50 and a standard deviation of 21.06. This resulted in an 
equal interval scale with a hypothetical range from 1 to 99. Trends on 
different tests could therefore be analyzed in a gross sense across states, 
recognizing that student populations and specific test content differed. 

In addition, achievement data from the National Assessment of 
Educational Progress (NAEP) were analyzed to provide a perspective on the 
performance of students within the RBS region relative to national norms. 
Reading assessment results are available for 1970, 1975, and 1980; 
mathematics assessments were conducted in 1973, 1978, and 1982. Results 
were reported at national and regional levels, but not a state levels. 

While it is useful and appropriate to compare trends in statewide test 
results across states, individual point scores and the magnitude of such 
scores are not directly comparable for several reasons. There are several 
limitations in the approach used to analyze results across states. Even 
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though a common score metric was derived, no direct comparison between 
state achievement levels at individual points can be made because each test 
differs with regard to content, difficulty level, norming samples, and 
other psychometric properties. The fact that two states may have equal 
standard scores does not imply that the relative level of actual student 
performance is equal. Likewise, the standard scores should not be regarded 
as normal curve equivalents (NCEs) based on national norms. A standard 
score of 50 in the reported analyses does not mean that achievement is at 
the national average; indeed, it may be significantly above or below the 
national average. All reported standard scores are based solely on the 
distribution of scores for students tested in each respective state. The 
purpose of the conversion of scores to a standard score metric is to enable 
meaningful indications of gross trends only. 

Another consideration in the analysis related to the comparability of 
student samples from year to year. In Pennsylvania, since participation in 
the program from year to year • is somewhat voluntary (i.e., districts are 
required to participate only once eveiy five years), the sample of 
districts changes from year to year. For example, Pennsylvania officials 
reported that a disproportionately high number of vocational students were 
tested in 1982. To some extent, Pennsylvania controls for annual 
variations by choosing a norming sample based on school district size and 
wealth. In New Jersey, since only certain grades are tested each year, the 
grade level populations may change from year to year. In addition, even 
though all districts in New Jersey. Delaware, and Maryland are tested each 
year, student populations participating in the testing program may differ 
from year to year due to such factors as mobility or changing group 
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composition. Group composition may change as a result of student 
classifications in special education or English as a Second Language (ESL) , 
since such students are exempted from testing. The actual extent to which 
statewide samples change from year to year is not known. The assumption in 
the analysis is that changes are not systematic and that samples are 
esentially comparable. However, sampling variations limit the accuracy of 
the year-to-year trend analyses. 

Due to the various design limitations, the findings should be viewed 
cautiously. There may be several plausible explanations for year-to-year 
changes, including instructional changes and changes in student 
characteristics. The accumulated data should be considered as a gross 
indication of generic student performance trends. 

The RBS analysis of student performance data consisted of two 
components— an analysis of common performance areas and an analysis of 
unique performance areas. Each analysis component is presented separately 
in the following sections of the report. 
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ASSESSMENT OF COMMON PERFORMANCE AREAS 

Ail state testing programs addressed student performance in reading 
and mathematics. Results for each grade level, by state, are presented In 
Tables 2 and 3. These do not include scores for ESL or special education 
students. Converted standard scores are reported for each of the last five 
school years as well as for the baseline year (1978). Unconverted scores 
are presented in the Appendix. Change scores over the last three school 
years and the entire period are also reported. As indicated in discussion 
of study limitations above, results should be cautiously interpreted, 
ocores displayed in Tables 2 and 3 are graphically presented in Figures 1 
and 2 to illustrate performance trends by state. Figures 3 and 4 show 
average performance trends across all the states. 

Reading Trends 

Long term trends from 1978 to 1984 showed improvement in reading at 
all grade levels across all states. Overall reading trends clearly 
indicate that results are strongest at the elementary and intermediate 
levels and weakest at the secondary level. 

Yearly score comparisons from 1981 on showed that scores in 
Pennsylvania declined slightly from 1981 to 1982 at the secondary level and 
from 1982 to 1983 at the elementary level. However, these scores improved 
in subsequent years. These results could be due to the variable sampling 
of schools which would tend to make the Pennsylvania findings fluctuate 
more from year to year. 

Scores in Delaware declined from 1983 to 1984 at all levels. This 
could be due to the testing instrument since Delaware began using the CTBS 
instead of the CAT during the 1983-84 school year. 



Table 2 

Sutewide Student Achievement Trends: Reading* 



Grade Level 
State 



jleatatary level 
PeDDBylvanla 
Nev Jersey 
Delavare 
Katyland 



School Year (end of yiti) 
1980 1981 



Intemedlate L»vel 
Pennsylvania 
New Jeraey 
Delavare 
Haryland 



Secondary Level 
Pennsylvania 
Nev Jeraey 
Delaware 
Harylandt 



50 
50 
50 
50 



50 
50 
50 
50 



50 
50 
50 



T 



m2 



54 
55 
55 
53 



51 
51 
52 
53 



52 
61 
56 
54 



4? 
54 
55 
53 



51 
53 



5? 
66 
57 
57 



51 
57 
58 
57 



46 
52 
53 



1983 



58 
57 



51 
59 
60 
57 



50 
54 



1984 



55 
59 



54 
62 
57 
58 



52 
53 



+/- 

61-82 



♦5 
+5 
+1 
+3 



+4 
+3 
+3 
+4 



-2 
+1 

0 



Change 
82-83 63-84 



+1 

0 



0 
♦2 
+2 

0 



♦4 
♦1 



-3 

*1 



*3 
♦3 
-3 
+1 



+2 
-1 



«d 1980 for )teryl.nd «re e.tlwted ^"""^ ""-'8 through 1983-84 ,chool ye.rB. IZlTm 

ir!;;:r fS,;;;. ^^--^ -dar, .ve. „e t. pe.od l,;a-.; for l.e™dla„ ,.de level, 
♦ Maryland does not ad^nlste: the W ceat at the secondary level. 



13 



Table 3 

Statewide Student Achievewnt Trends: Katheaatlcs* 



Gride Level 
State 



jleaeptary level 
Peoosylvasia 
Kev Jersey 
Delivare 
Nirylind 



19?8 



School Year (end of year) 
M 1981 1982 



1983 



1984 



InCeraedlflte Level 
PeonRylvfinla 
Nev Jersey 
Oelavare 
Karyland 



Secondary Level 
PeonsylvaDla 
Nev Jersey 
Delivtre 
Hai7laQdf 



50 
50 
50 
50 



50 
50 
50 
50 



50 
50 
50 



57 


53 


56 


60 


64 


67 


56 


59 


61 


54 


56 


60 


52 


48 


51 


54 


57 


60 


56 


59 


60 


53 


54 


57 


49 


45 


44 


52 


54 


56 


54 


55 


55 









62 
60 



51 
61 
61 
58 



46 
56 



59 

60 
63 



53 
64 
58 
59 



50 
55 



+/- 
81-82 




+3 
+3 
+2 
+4 



+3 
+3 
+1 
+3 



-1 

+2 

0 



0 
+1 
+1 
+1 



+2 
+1 



-2 
+3 



+2 
♦1 



+/- 
78-84** 



for re..oas dl.cu.«d h L 1 . L ,1^0. nlTr^VT^'V^I^^""' "^"^ ^' ^1"'"^ "i""! 

ind 1980 for (hrylMd wre ..rtated. ' ""-8« school years, Scores for 1978 

«Por Nev Jersey, overall gains for the clenientary and secondary levels are for the rerlDd ig78-R?. fnr ^^, . . ... . , , 

overall galu represents 1978-1984, ^ ""^ InterMdlate grade level, the 

+ Haryland does not adaliilster the CAT test at the secondary leveh 



+9 
+17 
+10 
+13 



+3 
+14 
+8 
+9 



0 
+6 
+5 



14 



70^ 



Elementary 

Reading 

Scale 

Score 



60 



50 



MD 




40 



197B 



1979 



1980 



1981 



vear 



1982 



1983 



198t 



70^ 



Intermediate 

Reading 

Scale 

Score 



60 



50 



AO ► 




1978 



1979 



1980 



1961 



1982 



ve;ir 



19S3 



198^ 



S econdary 

Reading 

Scale 

Score 



70 



60 



50 



40 




1978 



1979 



1980 



1981 



1982 



1983 



1984 



year 



y m J, «ew jersey ( t ), Delaware ("□"), and Maryland ("a") 
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15 



70 



Elementary 

Mathematics 

Scale 

Score 



60 



50 



40 



NJ 



MO 




1978 1979 1980 1981 1982 1983 1984 



vear 



Intermediate 

Mathematics 

Scale 

Score 



70^ 



60 



50 



40 




1378 



1979 



19B0 



19BI 



1982 



1983 



vear 



198- 
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Secondary 

Mathematics 

Scale 

Score 



70 



60 



50 



" s 



40 




— a OB 



FA 



1978 



1979 



1980 



1981 



1982 



1983 



1984 



year 



fnfpln; .Student performance in mathematics achievement, by ^rade level 

16 



12 



70^ 



Elementary 

Average 
Reading 
Scale 
Score 



60 



50 



40 



1978 



1979 



1960 



1981 



1982 



1983 



1984 



year 



Intermediate 

Average 
Reading 
Scale 
Score 



70 



60 



so 



40 ► 



year 



1978 



1979 



1980 



1981 



1982 



1983 



1984 



Secondary 

Average 
Reading 
Scale 
Score 



70 



60 



so 



40 



1978 



1979 



1980 1981 1982 1983 1984 

Figure 3 , Average student performance trends across all states in 
reading achievement by grade level. 
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13 



70^ 



Elementary 

Average 
Mathematics 
Scale 
Score 



60 



so 



40 »^ 



1978 



1979 



1980 



1981 



year 



1982 



1983 



198^ 



Intermediat e 

Average 
Mathematics 
Scale 
Score 



70 



60 



40 



1978 



1979 



1980 



year 



1981 



1982 



1983 



1984 
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Secondary 

Average 
Mathematics 
Scale 
Score 



60 



50 



40 



year 



1978 



1979 



1980 



1981 



1982 



1983 1984 

Figure U. Average student performance trends across all states in 
mathematics achievement by grade level. 
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Scores in Maryland remained stable from 1982 to 1983 at both the 
elementary and intermediate levels but increased in the 1983-84 school 
year. 

Results for the 1975-1980 comparisons in the National Assessment of 
3 

Educational Progress indicate improvement in reading comprehension of 
nine-year olds in the national sample and in the subsample for the 
Northeast region. Results for the 13-year old group show no significant 
change, while results for the 17-year old group indicate a slight, although 
nonsignificant, decline in reading achievement. The rate of decline for 
the Northeastern region subsample of 17 year oldf. is slightly greater than 
for the overall national sample. As can be seen in Figure 3 results across 
the statewide testing programs show trends somewhat similar to NAEP results 
though 1980 with elementary performance showing more improvement than 
intermediate and secondary. After that point, it appears that average 
performance trends across the states at the elementary level continue to 
Improve until 1983 when the trend lowers and begins to level off. Results 
at the intermediate level show a steady increase while results for 
secondary schools remain relatively stable with an upward trend beginning 
to appear in 1983 and 1984. 

Math Trends 

In mathemat^'^^, long term trends from 1978 to 1984 showed improvement 
across all grade le id states with the exception of Pennsylvania's 

scores at the secc da I which remained stable. Overall mathematics 

trends were most pos he elementary grade level and least positive 

at the secondary level. 
3 

National Assessment of Ed^ 1 egress. The national assessments 

of reading; Changes in p.rfc .ance, 70-19f . Denver, Colorado: 
Education Commission of the St tes, 19ci. 
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Yearly comparisons from 1981 on showed that scores in Pennsylvania 
declined slightly from 1981 to 1982 at the secondary level but increased in 
subsequent years to remain stable over the six year period. 

Scores in Delaware declined in mathematics as well as reading from 
1983 to 1984 at all levels. This could be due to the change in the test 
instrument used. 

Mathematics results for the NAEP were reported for the period from 
1973 through 1982.^ Results at various age levels are somewhat different 
than those for reading. Differences may reflect changes in student 
population and/or actual achievement from 1980 to 1982. Findings for the 
nine-year old group were stable across all three assessments (1973, 1978, 
and 1982). For 13-year olds, mathematics achievement declined during the 
initial period, but significantly increased from 1978 through 1982. 
Results for the 17-year old group declined from 1973 to 1978 but leveled 
off during the latter period. Authors of the report suggested that the 
test instruments were more sensitive to recent changes in curriculum and 
instruction at the intermediate grade level than for other grade levels. 
In addition, they added a cautionary note indicating that, although 
secondary school students do well on relatively easy tasks (e.g., routine 
computation), results for higher order tasks were not as impressive. This 
finding has often been noted by the recent educational literature as a 
result of concentrating on "minimum competencies" at the expense of higher 
order skills. As can be seen in Figure 4, in general, NAEP findings for 



4 

National Assessment of Educational Progress. The third mathemat ics 
assessment; Results, trends, and issues (1981-82 assessment) . Denver, 
CO: Education Commission of the States, 1983. 
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intermediate and secondary grades are similar to the results across the 
state-wide testing programs. State mathematics trends at the elementary 
level are more positive than that suggested by the NAEP. Results begin to 
level off after 1982 at the elementary level and after 1983 at the 
intermediate level. Performance remains relatively stable at the secondary 
level. 

Overall Performance 

Although student achievement in Pennsylvania and New Jersey cannot be 
compared to national norms, CAT and CTBS results for Delawar-g were 
available in NCE scores based on the national standardization sample and 
CAT scale scores from Maryland could be translated into NCE scores. These 
results are presented in the Appendix. Overall, results indicate that, 
especially during recent years, Delaware and Maryland students scored 
higher than the national average in both reading and mathematics, 
particularly at the elementary grades. Likewise, these results clearly 
illustrate that high achievement at the lower grades tapers off by the high 
school level. Reading results from the NAEP assessment are similar to 
these findings. Scores for students in the Northeast region at all age 
levels are higher than the national average, particularly for the nine-year 
old group. Scores are not much higher than the national average for the 
older groups of students. 



er|c " 



ASSESSMENT OF UNIQUE PERFORMANCE AREAS 

Testing programs in Pennsylvania, Delaware, and Maryland include 
components in addition to reading and mathematics. These results are 
described below for each state. The New Jersey assessment program does not 
address any other subject area besides reading and mathematics and is 
therefore not included in this section. 

Pennsylvania 

Results in other areas addressed by the EQA are presented in Table 4. 
Average scores are reported as standard scores referenced to mean scores in 
1978. The data indicate general trends by grade level, for each of the 
learning goals. However, it must be recognized, again, that specific point 
scores are not directly comparable across grade levels due to differences 
in the psychometric properties of the tests (e.g., test difficulty). Grade 
level differences are only valid in the sense of general trends from year 
to year. Actual raw score means are presented in the Appendix. 

To some extent, trends are inconsistent, with varying patterns across 
subtests and grade levels. Results are more likely to fluctuate from year 
to year because of sampling variations. 

Changes from 1983 to 1984 varied between levels. At the elementary 
level there were substantial increases in interest in school, societal 
responsibility, creativity, and appreciating human accomplishments. Scores 
on understanding others, writing, knowledge of law/government, health, 
career awareness, and information usage increased while self-esteem, and 
knowledge of hunan accomplishments remained stable. No areas declined. 
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Table 4 



Student Acbleveoent In Qolque Perfoniance Areas: Pennsylvania 



SUBTEST 
Grade Level 


1 D7D 


School Year (end of year) 
19B0 1981 1982 


■ 1983 


no** 




Chang 


e 

' +/- 

a J OH 


+/- 
7fl*fl4 


SEF-ESTEEH 








1 












Eleaenciry 


50 


51 


50 


51 i 53 


53 


+1 


+2 


0 


+3 


Inc^nDedlac? 


50 


50 


50 


50 56 




u 






+ 13 


Secondary 


50 


<;9 


51 


55 59 


61 


+4 


+4 


+2 


+11 


UNDERSTANDING OTHERS 






















EleMntary 


50 


55 


52 


53 


54 


55 


+1 


+1 


+1 


♦5 


Interned late 


50 


48 


45 




48 


H 


u 


'J 






Secondary 


50 


hi 


48 




43 


51 


-9 


t4 


+6 


+1 


VRITIKG 






















Elenentary 


50 


54 


52 




58 


60 


+5 


♦1 


+2 


+10 


lucerMQiaic 


j\i 


53 


49 




57 




~u 


+2 


+2 


+9 


Secondary 


50 


50 


47 




51 


55 


0 


+4 


+4 


+5 


INTEREST IN SCHOOL 






















Eleventary 


50 


50 


48 




48 


54 


-2 


♦2 


♦6 


+4 


Intenedlite « 


50 


53 


54 




58 


64 


+1 


+3 


♦6 


+14 


Secondary 


50 


kl 


53 




62 


65 


+6 


+3 


+3 


+15 


SOCIETAL RESPONSIBILin 






















Eleaentary 


50 


56 


50 




50 


60 


+4 


-4 


+10 


+10 


Inte mediate 


50 


62 


57 




60 


70 


+3 


0 


♦10 


+20 


Secondary 


50 


48 


45 




48 


60 


-1 


+4 


+12 


+10 


KNOVLBDGE UW/GOVT. 






















Elewntary 


50 


53 


54 




55 


59 


0 


+1 


+4 


+9 


Interned late 


50 


49 


49 




51 


54 


+2 


0 


+3 


+4 


Secondary 


50 


51 


48 




49 


51 


-1 


+2 


+2 


+1 


HEALTH 






















Eleoentary 


50 


5) 


54 




58 


60 


+5 


-1 


+2 


+10 


Inten&edlate 


50 


55 


46 




50 


58 


+1 


+3 


+8 


+8 


Secondary 


50 


52 


48 




55 


61 


♦7 


0 


+6 


+11 
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Table i (continued) 







School Year (end of year) 








Change 




SUBTEST 
Grade Unl 


1978 


1960 


1981 


1982 


1983 


1984 


81-82 


82-83 


+/. 

83-84 


78-84 


CREATIVITY 
Eleoent^ry 
iDtenediate 
Secoodary 


50 
50 
50 


50 
43 
40 


11 

44 


46 
46 


1 47 
i 46 
43 


53 
48 
46 


-5 
-5 

-4 


+1 
0 
+3 


+6 
♦2 
♦3 


+3 
-2 

-4 


CAREEK AVARENESS 
EltncDtirv 
Interoedlate 
Secondary 


50 
50 


55 
52 
50 


51 
51 
48 


56 

55 
48 


55 
55 
30 


57 
56 

5i 


+5 

+4 • 
0 


0 

+2 


+2 
♦1 
+1 


+7 
+6 
+1 


APPRECIATING HMN 
ACCOHPLISRMENTS 
EleQeatftry 
Intenediace 
Secondary 


50 
50 
50 


54 
50 
42 


53 
53 
40 


56 
53 
41 


50 
52 
39 


58 
63 
47 


+3 
0 
+1 


'6 
-1 
-2 


♦8 
+11 
♦8 


♦8 

♦13 

-3 


DIOVLEDGE HUMAN 
ACCOKPLISHMEirrS 
Bleientary 
iQCenedlate 
Secondary 


50 
50 
50 


51 
48 
42 


47 
44 
40 


48 
52 
41 


49 
46 
35 


49 
42 
35 


+1 
+8 
+1 


+1 
•6 
-6 


0 

-4 

0 


-1 
-8 
-15 


IKFORHATION USAGE 
Eleneotary 
IneeriDediate 
Secondary 


50 
50 
50 

- 


54 
50 
51 


51 
49 
50 


i 

1! i 

47 


55 
51 
50 

. 


58 
55 
53 


+4 
+2 
-3 


0 
0 

+3 


♦3 
+4 
+3 


♦8 
♦5 
♦3 
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At the intermediate level from 1983 to 1984, scores on self-esteem, 
interest in school, societal responsibility, health, and appreciating human 
accomplishments increased substantially. All areas showed increases to 
some extent with the exception of knowledge of human accomplishments which 
declined. 

From 1983 to 1984, secondary scores increased in all areas except 
knowledge of human accomplishments (which remained stable) with substantial 
increases in understanding others, societal responsibility, health, and 
appreciating human accomplishments. For many of the secondary subtests, 
negative trends began to reverse in 1983-1984 

In general, subtests across all three grade levels from 1983 to 1984 
either remained stable or increased with substantial increases occurring in 
societal responsibility and appreciating human accomplishments. Interest 
in school increased substantially at both the elementary and intermediate 
levels and health at the intermediate and secondary levels. 

Delaware 

Results in the other areas addressed by the DEAP (spelling and 
language) are presented in Table 5. Again, average scores are reported as 
standard scores referenced to the baseline results and should not be 
confused with nationally-normed NCE scores. National NCEs are presented in 
the Appendix. 

Achievement scores in spelling and language across all three grade 
levels increased between 1978 to 1983, but decreased in 1984 in all areas 
except secondary language. These decreases reflect the trend in reading 
and mathematics and is probably due to the test instrument. Delaware began 
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Table 5 

Student Achievement in Unique Perfonnance Areas: Delaware 





1 


School Year (end 


of year) 








Ciianjje 




















+/- 
81-82 








Grade Level 


1978 


1980 


1981 


1982 


1983 


1984 


V- 
82-83 


83-84 


V- 

78-84 


SPELLING 






















Elementary 


50 


57 


58 


N.A.* 


62 


58 






-4 




Intemedlate 


50 


57 


59 


N.A.* 


59 


58 


- 


- 


-1 


+8 


Secondary 


50 


53 


54 


N.A.* 


JJ 


5' 






-1 


+4 


LANGUAGE 






















Elementary 


50 


57 


59 


60 


64 


60 


+1 


+4 


.1, 


+10 


Intermediate 


50 


55 


57 


61 


62 


60 


+4 


+1 


-2 


+10 


Secondary 


50 


53 


54 


56 


58 


58 


+2 


+2 


0 


+8 











*Spelling results for 1982 not available, 
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using the CTBS instead of the CAT during the 1983-84 school year. 
Decreases were more drastic at the elementary level in both spelling and 
language. Even with the decline in scores during 1983-84, overall trends 
across the six-year period from 1978 to 1984 were positive. These trends 
seem to be stronger at the elementary and intermediate levels than they are 
for the secondary level. In relation to national norms, Delaware students 
score higher than national averages in spelling and language (see NCE's in 
Appendix) . 

Maryland 

Results in other areas addressed by the Maryland testing program 
(language) are presented in Table 6. As was the case earlier for 
Pennsylvania and Delaware, Maryland's average scores are reported as 
standard scores referenced to the baseline results and should not be 
confused with nationally-nonned NCE scores. Scale scores and NCE's are 
presented in the Appendix. 

Achievement scores showed steady increases across the six year period 
from 1978 to 1984 at both the grade levels tested (elementary and 
intermediate).^ Increases were greatest between 1981 and 1982. In 
relation to national norms, Maryland students score higher than national 
averages in language (see NCE's in Appendix). 



Maryland began using the CAT during the 1980-81 school year. Scores for 
1978 and 1980 were estimated using the method of least squares. 
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Table 6 



10 



Student Achievement in Unique Perfomance Areas: karyland* 



*Score8 for 1978 and 1980 were estinated 
*Kot tested 



SUBTEST 




School Year (end of wsr) 








Chani^e 


Grade Level 


1978 


1980 


1981 


1982 


1983 


1984 


81-82 


82-83 


LANGUAGE 
Elenentaty 
Interaediate 
Secondary** 


50 
50 


53 




56 
54 


5? 
58 


60 
58 


62 
60 


+3 
+4 


i 

+ 1 

0 



+/- 



+2 
♦2 
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CONCLUSIONS 



A review of results from the four statewide testing programs suggests 
the following conclusions with respect to both common performance areas 
(reading and mathematics) and unique performance areas: 

• Long-terra trends in basic skills across all four states tended to 
be most positive at the elementary levels and least positive at 
the intermediate and secondary level. These findings are 
generally consistent with NAEP results. 

• In general, long-term achievement trends exhibited on New 
Jersey's MBS test were positive. This finding follows from 
results of the NAEP which found that students' performance is 
improving with regard to "minimum competencies." NAEP findings 
illustrate that today's students perform better on items testing 
"minimum competencies" than on items tapping "higher order 
cognitive" skills. 

• Delaware test results show that student achievement at all grade 
levels eyiceeds national norms. However, the results also 
illustrate that achievement relative to national norms is much 
stronger at the elementary grades and that positive performance 
tapers off by the secondary school grades. Delaware scores 
dropped at all levels in 1984 probably due to a change in the 
testing instrument used. 

• Pennsylvania results suggest that long-term student performance 
trends seem to be more positive at the elementary and 
intermediate levels than at the secondary level, although 
negative trends in many areas at the secondary level began to 
reverse in 1983-1984. 

• Maryland scores showed positive trends. In general, student 
achievement at all levels exceeds national norms. 

• In general, basic skills trends across the states increased 
during 1983-1984 with the exception of Delaware's scores. 
Results for secondary school students in Pennsylvania 
discontinued the consistent downward trends of prior years, as 
scores began to improve. 

The findings suggest that student achievement performance in the four 

state region (Pennsylvania, New Jersey, Delaware, Maryland) reflects the 

results of national studies. Long-term achievement trends are generally 

positive. In fact, findings in several areas are more positive than those 
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indicated by the national trends. However, the findings also suggest 
several areas for improvement. 

Despite the positive long-term trends overall, there is a decrease in 
positive long-term trends evidenced as one moves from the elementary to the 
intermediate and secondary levels. Implications can be dravn from this 
relative to the allocation of resources across education levels. In terms 
of school resources, it suggests that more attention be given by schools to 
programs aimed at the improvement of secondary education. If a movement 
can be initiated at the secondary level paralleling the emphasis on early 
childhood and elementary education the nation has experienced over the past 
decade or more, then perhaps a similar impact on secondary achievement 
trends can be attained. 

In terms of the kinds of skills being taught in recent years, both 
educational objectives and tests have gravitated toward the concept of 
"minimum basic skills." The New Jersey Minimum Basic Skills testing 
program has been one example of this. The increasing movement to minimum 
high school graduation standards and tests by several states is another. 
State education agencies are beginning to realize that there is more to 
"effective schooling" than just the "minimum basic skills." Additional 
attention clearly needs to be focused on higher order cognitive skills, 
such as problem solving, reasoning, and critical thinking. New Jersey 
recently has recognized this problem by initiating a change in the focus of 
their testing program from a minimum competency test to a wider ranging 
achievement test as the measure of school and studenc accountability. 
Maryland also uses criterion-referenced testing of a wide range of skills 
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for high school graduation. Finally, the Pennsylvania findings illustrate 
the need to focus on affective areas as well as cognitive areas. 

In summary, overall long-term statewide achievement trends over the 
past six years are encourap:ing. The assessments show that schools can have 
a demonstrable impact on lent perfoimance when concerted efforts are 
targeted at specific problem areas. The recent literature on effective 
schools, the NAEP reports, and reports of several national study 
commissions (e.g., the National Commission on Excellence in Education, the 
National Task Force on Education for Economic Growth, and the Task Force on 
Federal Elementary and Secondary Educational Policy) have suggested a 
number of ways for increasing student achievement. RBS' experience with 
effective schools in the four-state region indicates that many schools are 
implementing such R&D findings to improve school practices. To a large 
extent, these improved practices may account for improvements in 
demonstrated achievement trends in the basic skills. Practitioners need to 
continue and expand these improvement efforts in order to maximize student 
performance -a all achievement areas (cognitive and affective) at all grade 
levels. 
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APPENDIX 

Student Performance Results: Statewide Unconverted Scores 



STATE 
Grade Level 



Subtest 


1 1978 


1980 


1981 


1982 


1983 


; 1984 


PENNSYLVANIA - raw scores 












i 

1 

1 


Elementary 














Self-Esteem 


62.1 


62.3 


62.2 


62.3 


62.6 


62.7 


understanding Others 


119.0 


120.8 


119.5 


120.2 


120.3 


121.0 


Reading 


27.0 


27.8 


27.4 


28.2 


27.9 


28.1 


Writing 


28.6 


29.2 


29.0 


29.7 


29.8 


30.1 


Mathematics 


36.3 


37.6 


36.8 


37.4 


37.5 


37.9 


Interest in School 


55.4 


55.4 


55.1 


54.9 


55.2 


56.0 


Societal Responsibility 


42.8 


43.7 


42 8 


1 J . t 


'iL . 0 




Know. Law/Govt. 


10.8 


11.0 


11.1 


11.1 


11.2 


11.4 


Health 


28.9 


29 8 


17* 4 


JU. 4 


JU. u 


jU,Z 


Creativity 


53.5 


53.4 


53.6 


52.4 


52.5 


54.1 


Career Awareness 


24.4 


24.9 


24.5 


25.1 


24.9 


25.2 


App. Human Accomp. 


147.7 


149.6 


149.2 


150.7 


147.5 


151.3 


Know. Human Accomp. 


21.8 


21.9 


21.3 


21.5 


21.5 


21.7 


inrormation Usage 


18.5 


19.0 


18.7 


19.1 


19.1 


19.4 


Intermediate 














Self-Esteem 


58.3 


58.3 


58.2 


58.3 


29.0 


59.7 


Under. rending Others 


112.4 


111.8 


110.8 


111.0 


111.9 


112.9 


Reading 


26.9 


27.1 


26.5 


27.1 


27.1 


27.5 


writing 


36.3 


36.8 


36.2 


37.0 


37.3 ! 


37.6 


Mathematics 


31.6 


32.0 


31.3 


31.7 


31.8 I 


32.1 


Interest in School 


67.6 


68.0 


68.2 


6']. 6 


69.2 1 


70.7 


Societal Responsibility 


59.9 


61.7 


61.0 


61.4 


61.4 1 


63.0 


Know. Law/Govt. 


24.9 


24.8 


24.8 


25.1 


25.2 ; 


25.5 


Health 


87.4 


88.3 


86.8 


87.0 


87.4 i 


88.7 


Creativity 


47.1 


45.6 


47.4 


46.3 


46.2 


46.8 


Career Awareness 


23.0 


23.2 


23.1 


23.5 


23.5 ! 


23.6 


App, Human Accomp. 


31.0 


130.8 


132.2 


132.3 


131.5 ; 


136.6 


Know. Human Accomp. 


30.3 


30.0 


29.6 


29.3 


29.6 ! 


28.9 


Information Usage 


14.9 


14.9 


14.8 


14.9 


15.0 : 

1 


15.3 
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APPENDIX (contd.) 

STATE 
Grade level 



Subtest 


1978 

1 


1980 


! 1981 


1982 


1983 


1984 


Secondary 


1 

1 




1 

1 

1 

1 








Self-Esteein 


58.9 


58,8 


59,1 


59 5 


59 9 


60.1 


Understanding Others 


114.4 


113,7 


112.9 


111 6 


112.7 

J. 1 b . / 


114.5 


Reading 


25.1 


25.4 


24 9 


24.6 


25 1 


25.4 


Writing 


34.7 


34.7 


34 4 


34 3 


34 8 


35.3 


Mathematics 


35.4 


35.2 


34 6 


34 5 


34.8 


35.3 


Interest in School 


63.5 


62.9 


64.2 


65.6 


66.1 


66.8 


Societal Responsibility 


50.7 


50 5 


50 2 


50 1 


50 2 


51.7 


Know. Law/Govt. 


24.8 


24.9 


24.5 


24.4 


24.7 


24.8 


Health 


80.9 


81.3 


80.6 


81.5 


81.9 


82.9 


Creativity 


43.3 


41.1 


41.9 


41.1 


41.7 


42.3 


Career Avjareness 


22.9 


22 9 


22 8 


22 8 


22 9 


23.0 


App. Human Accomp. 


131.9 


129.1 


128.4 


128.7 


128.0 


130.9 


Know. Human Accomp. 


28.2 


27.1 


26.4 


26.0 


26.2 


26.0 


Information Usage 


17.9 


17.9 


17.8 


17.6 


17.9 


18.1 


NEW JERSEY - MBS scores 














Elementary 














Reading 


81.9 


84.9 


88.9 


91.6 






Mathematics 


72.5 


80.5 


83.7 


85.9 






Intermediate 














Reading 


82.6 


83.8 


86.1 


88.2 


90.1 


92.5 


Mathematics 


75.5 


78.9 


81.1 


83.3 


83.7 


85.6 


Secondary 














Reading 


88.9 


87.8 


89.6 


90.2 






Mathematics 


80.6 


81.8 

1 


83.4 


84.5 
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APPENDIX (conr-;.) 

STATE 



Grade Level 



Subtest 


1978 


1980 


1981 


1982 


1983 


1984 


DELAWARE - NCEs 






















Elementary 




i 


















Reading 
Mathematics 
Spelling 
Language 


52 
51 
51 

5 


57 
57 
58 
60 


58 
60 
59 
62 


59 
62 

\\ A 
63 


60 
63 
62 
64 




56 

61 
58 
59 


Intermediate 






















Reading 
Mathematics 
Spelling 
Language 


52 
50 
48 
50 


54 
56 
55 
55 


57 
59 
57 

57 


58 
60 
N A 
61 


60 
61 
59 
62 




57 
58 
58 
61 


Secondary 






















Reading 
Mathematics 
Spelling 
Language 


52 
50 
48 
50 


54 
51 
53 


55 
55 
52 
54 


55 
55 
N A 
56 


56 
56 
55 
58 




54 
56 
54 
5/ 


MARYLAND - scale scores A 
NCE scores 

Elementary 






Scale 
Scores 


NCE 


Scale 
Scores 


NCE 


Scale 
Scores 


NCE 


Scale 
□cores 
























Reading 

Mathematics 

Language 


— 


— 


479 
450 
507 


59 
53 
56 


487 
457 
516 


61 
57 
60 


487 
459 
519 


61 
58 
61 


492 
464 
524 


64 
60 


Intermediate 






















Reading 

Mathematics 

Language 






558 
552 
562 


55 
53 
53 


570 
562 
572 


59 
56 
57 


570 
566 
575 


59 
58 
57 


576 
571 
580 


60 
58 
59 


Secondary (Not tested) 1 
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